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FOREWARD 


This  final  report  summarizes  the  research  and  activities  under  the  ODDR&E  MURI  on 
the  topic  of  Data  fusion  in  Large  Arrays  of  Microsensors  (Sensor Web).  The  universities 
involved  in  this  program  are  the  Massachusetts  Institute  of  Technology  (through  which  the 
grant  is  administered),  the  University  of  Illinois,  and  Princeton  University.  The  principal 
investigators  for  this  grant  are  Prof.  Alan  Willsky  (MIT),  Prof.  Sanjoy  Mitter  (MIT),  Prof. 
Sanjeev  Kulkarni  (Princeton),  Prof.  P.R.  Kumar  (Illinois),  and  Prof.  Tonnni  Jaakkola  (MIT). 

In  recent  years  there  has  been  an  emergence  of  a  number  of  new  sensing  concepts,  many 
of  which  involve  inexpensive  and  small  sensors  that  can,  in  principle,  be  deployed  in  large 
numbers  to  provide  enhanced  spatio-temporal  sensing  coverage  in  ways  that  are  either  pro¬ 
hibitively  expensive  or  impossible  using  conventional  sensing  assets.  Realizing  the  potential 
of  such  large,  distributed  sensor  systems,  however,  requires  major  advances  in  the  theory 
and  fundamental  understanding  of  distributed  data  fusion  in  highly  uncertain  environments 
using  sensing/communications  nodes  that  are  severely  constrained  in  computation  and  com¬ 
munication  capabilities.  The  overall  goal  of  this  MLIRI  is  to  further  this  basic  theory  and 
understanding  by  addressing  problems  including:  consistent  fusion  algorithms  for  networked 
sensors;  adaptive  collaborative  processing  in  highly  uncertain  environments;  and  transmis¬ 
sion  of  information  in  large  and  uncertain  networks.  Other  major  goals  of  this  program  are 
the  training  of  graduate  students  and  post-doctoral  associates  so  that  they  are  equipped  to 
tackle  multidisciplinary  challenges  such  as  those  embedded  in  the  Sensor  Web  concept  and  to 
communicate  our  ideas  and  results  to  others  in  the  DoD  community  to  further  efforts  aimed 
at  realizing  the  potential  of  microsensor  arrays. 

During  this  program,  we  have  had  considerable  success  in  every  dimension  of  our  ef¬ 
forts:  in  producing  fundamental  advances  to  the  intellectual  challenges  presented  by  the 
SensorWeb  concept;  in  establishing  a  leadership  position  for  our  team  and  team  members 
in  this  very  important  area;  in  developing  substantive  interactions  and  collaborations  with 
other  academic  research  efforts  including  MURI’s  in  related  areas;  in  pursuing  and  establish¬ 
ing  partnerships  with  industrial  and  DoD  R&D  activities  which  have  already  led  to  several 
transitions  of  our  work;  and  in  training  a  substantial  group  of  young  researchers  who  have 
contributed  to  our  successes  and  who  are  now  poised  to  become  research  leaders  in  their 
own  right.  In  this  report  we  describe  the  major  themes  of  our  research  and  provide  brief 
summaries  of  our  research,  highlighting  key  results;  describe  our  interactions  and  collabora¬ 
tions  with  academia  and  with  our  industrial  and  DoD  partners;  provide  a  prospective  look 
at  our  vision  for  the  future;  and  include  factual  information  on  personnel,  publications  and 
presentations.  Further  details  about  all  activities  associated  with  this  MURI  can  be  found 
on  our  website:  http://sensorweb.mit.edu 
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1  INTRODUCTION 


This  final  report  summarizes  the  research  and  activities  under  the  ODDR&E  MURI  on  the 
topic  of  Data  fusion  in  Large  Arrays  of  Microsensors  (Sensor Web).  The  universities  involved 
in  this  program  are  the  Massachusetts  Institute  of  Technology  (through  which  the  grant  is 
administered),  the  University  of  Illinois,  and  Princeton  University.  The  principal  investigator 
for  this  grant  is  Prof.  Alan  Willsky  (MIT).  Prof.  Willsky  is  joined  in  leading  this  program 
by  Prof.  Sanjoy  Mitter  (MIT),  Prof.  Tonnni  Jaakkola  (MIT),  Prof.  John  Tsitsiklis  (MIT), 
Dr.  Mujdat  Cetin  (MIT),  Dr.  John  Fisher  (MIT),  Prof.  P.R.  Kumar  (Illinois),  Prof.  Sanjeev 
Kulkarni  (Princeton),  and  Prof.  Sergio  Verdu  (Princeton). 

During  this  program  we  have  had  considerable  success  in  every  dimension  of  our  effort. 
First  of  all,  our  research  has  resulted  in  fundamental  advances  in  each  of  the  lines  of  inquiry 
that  make  up  our  program  and  that  span  all  of  the  research  challenges  spelled  out  in  our 
proposal  and  in  the  original  call  for  proposals.  Second,  we  have  been  quite  successful  in 
establishing  program  infrastructure  and  internal  interactions  that  have  been  of  immense 
help  both  in  facilitating  our  multidisciplinary  research  and  in  presenting  and  promoting  the 
activities  of  our  program.  Third,  our  research  has  received  considerable  attention  from  the 
academic  and  broader  R&D  community,  and  members  of  our  team  have  been  widely  sought 
for  invited  talks  and  papers  and  have  established  leadership  positions  in  the  community. 
Fourth,  we  have  established  substantive  interactions  and  collaborations  with  other  academic 
efforts  including  MLIRI  teams  working  in  related  areas.  Fifth,  we  have  been  active  in  fostering 
and  developing  interactions  with  industrial  and  DoD  partners,  leading  even  at  this  early  stage 
to  several  transitions  and  establishing  a  base  for  much  more  leveraging  of  our  research  in 
the  future.  Finally,  thanks  to  this  research  program,  our  educational  mission  has  been  a 
resounding  success.  In  particular,  this  program  has  played  a  central  role  in  the  training  and 
development  of  a  substantial  group  of  young  researchers  who  not  only  have  contributed  to 
our  successes  but  also  are  now  poised  to  become  multidisciplinary  research  leaders  in  their 
own  right. 

In  this  report  we  provide  a  brief  summary  of  these  activities  and  accomplishments  (and  we 
also  refer  the  reader  to  Section  3  for  a  complete  list  of  publications  resulting  from  this  program 
and  to  our  website  http://sensorweb.mit.edu)  for  additional  information  and  descriptions  of 
our  research  and  activities).  In  the  next  subsection  we  briefly  discuss  our  intellectual  vision 
and,  in  particular,  the  overlapping  intellectual  themes  of  our  research  program.  We  also 
review  the  research  concentration  areas  that  were  identified  in  the  original  call  for  proposals 
for  this  MLIRI  topic. 

Section  1.2  includes  some  basic  factual  information,  including  a  list  of  all  personnel  who 
have  been  involved  in  this  project  (and  indicating  advanced  degrees  earned  while  working 
on  this  project).  As  this  list  makes  clear,  we  have  involved  a  very  large  number  of  students, 
indicating  both  the  impact  of  this  MLIRI  effort  on  the  educational  programs  at  our  three 
universities  and  the  amount  of  leveraging  of  MLIRI  funds  we  have  been  able  to  achieve. 
Section  1.3  then  provides  a  brief  summary  of  our  many  activities  and  the  impact  they  are 
having  in  the  broader  intellectual  community  and  our  collaborations  with  and  transition  to 
industry  and  the  DoD  community.  In  Section  2,  we  then  present  a  brief  summary  of  the 
most  important  results  of  our  efforts. 
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1.1  Intellectual  Themes  and  Research  Concentration  Areas 

The  overall  objective  of  this  program  was  the  investigation  and  development  of  innovative 
concepts  and  solutions  to  the  challenges  presented  by  the  envisioned  availability  of  very 
large  numbers  of  heterogeneous  sensors  each  of  which  is  limited  in  sensing  capability,  power, 
computation,  and  communication.  These  challenges,  while  motivated  here  by  military  appli¬ 
cations,  are  of  pervasive  importance,  as  the  concept  of  “ubiquitous”  sensing,  computing,  and 
control  moves  from  a  dream  to  a  reality.  True  advances  toward  this  vision  require  cutting 
across  boundaries  between  functions-sensing,  communication,  and  application  (i.e.,  exploita¬ 
tion  of  the  sensed  data)-and  also  meeting  new  challenges  due  to  the  desire  to  deploy  such 
systems  economically  in  complex,  unknown,  and  uncertain  environments.  As  a  result  the 
boundaries  between  wireless  communications,  sensor  fusion,  computational  complexity,  and 
adaptation  are  at  best  blurred  and  more  likely  obliterated  by  the  demands  of  this  ambitious 
new  vision. 

The  primary  goal  of  this  MURI  program  was  to  make  fundamental  contributions  to  the 
foundations  of  what  is  truly  a  new  discipline.  Thus  we  have  sought  not  only  to  develop  new 
results  for  important  problems  within  this  domain  but  also  to  seek  new  formulations  that 
cut  across  disciplinary  boundaries  and  help  to  give  shape  to  this  emerging  field.  While  we 
view  our  efforts  holistically,  we  have  found  it  helpful,  for  the  purposes  both  of  presentation 
and  of  organizing  our  own  thoughts,  to  group  the  intellectual  challenges  of  this  new  domain 
into  three  interrelated  intellectual  themes  (IT’s): 

IT-1:  Consistent  (or  manageably  inconsistent)  fusion  of  networked,  myopic  sensors.  At 
its  basic  level,  research  in  this  area  examines  questions  of  the  following  type:  Given 
constraints  on  communication  and  computation/memory,  as  well  as  a  complete  prob¬ 
abilistic  model  capturing  relationships  among  sensors  and  the  variables  they  measure, 
determine  provably  good  algorithms  for  the  fusion  of  the  available  sensor  data  for  the 
purposes  of  estimation  and  detection,  and  quantify  or  bound  their  performance  charac¬ 
teristics.  This  theme  interacts  strongly  with  IT-3  to  follow  as  we  strive  to  understand 
how  network  information-theoretic  constraints,  computational  capabilities,  and  fusion 
algorithm  performance  interact.  This  theme  also  demands  investigations  captured  in 
IT-2  as  we  pursue  more  adaptive  fusion  solutions  that  accommodate  additional  levels 
of  uncertainty  and  variability  that  will  be  the  rule  rather  than  the  exception  in  many 
sensor  networks. 

IT-2:  Fusion  and  self-organization  of  heterogeneous  sensors  in  unstructured  and  uncertain 
environments.  The  basic  problems  of  concern  in  this  area  involve  the  fusion  of  sensor 
data  when  the  relationships  among  the  signals  sensed  by  different  sensors,  the  charac¬ 
ter  of  those  signals,  and  the  environment  in  which  they  are  propagated  from  source  to 
sensor  are  uncertain,  variable,  or  simply  unknown.  Developing  solution  methods  for 
problems  of  this  type  are  essential  in  order  to  construct  network-constrained  fusion  al¬ 
gorithms  (IT-1)  that  are  robust  to  these  uncertainties  and  that  can  learn  from  observed 
data  and  then  adapt  based  on  what  is  learned.  In  addition,  the  constraints  of  network 
communication  (IT-3)  constrain  how  such  learning  or  adaptivity  can  be  accomplished. 
How  do  we  determine  which  bits  are  the  most  important  to  communicate  in  order  to 
learn  what  the  most  important  bits  are  to  communicate? 
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IT-3:  Wireless  networks,  network  communication  and  information  theory.  One  component 
of  this  portion  of  our  research  agenda  is  information-theoretic.  Given  a  wireless  net¬ 
work  and  communication  capabilities  of  each  of  the  network  nodes,  what  are  the  limits 
on  information  that  can  be  communicated  throughout  the  network.  Such  an  investi¬ 
gation,  which  moves  us  toward  the  goal  of  network  information  theory,  is  concerned 
fundamentally  with  moving  bits  from  multiple  origins  to  various  destinations.  Develop¬ 
ing  results  along  these  lines  provides  what  are  in  essence  constraints  for  the  challenges 
to  be  met  by  network-constrainted  (IT-1)  and  robust,  adaptive,  and  self-organizing 
(IT-2)  fusion.  This  also  suggests  other  problems  in  which  we  consider  the  interac¬ 
tion  of  communication  and  fusion  directly.  That  is,  the  issue  of  which  bits  are  to  be 
moved  from  one  place  to  another  is  intricately  bound  up  with  the  goals  and  structure 
of  fusion-  i.e.,  with  the  distortion  measures  of  importance  in  measuring  fusion  quality 
and  with  the  fact  that  the  fused  products  themselves  will  be  distributed  throughout 
the  network  (so  that,  in  particular,  every  transmitter  is  also  a  receiver  and,  in  fact  is 
actually  a  receiver  of  its  own  transmission  once  it  is  fused  with  information  elsewhere 
in  the  network).  These  ultimate  challenges  represent  areas  in  which  all  three  of  our 
themes  converge. 

These  three  themes  represent  what  we  have  found  to  provide  a  very  useful  organization  of 
the  intellectual  agenda  of  this  MURI.  An  alternate  parsing  of  this  agenda-which  has  varying 
levels  of  granularity  from  intellectually  broad  to  much  more  narrowly  focused-is  that  found 
in  the  original  description  of  this  MURI  topic.  That  document  spelled  out  seven  research 
concentration  areas  (RCAs).  The  following  is  a  list  of  concise  statements  of  these  RCAs 
(for  the  full  text  of  each  RCA,  we  refer  the  interested  reader  to  the  original  BAA  description 
for  this  MURI,  available  on  our  website);  also,  after  discussion  early  in  this  proposal  with 
MURI  program  manager,  Dr.  John  Lavery  of  the  Army  Research  Office,  RCAs  2  &  3  were 
grouped  together): 

RCA-1:  Self-calibration 

RCA-2&3:  Fundamental  limits  on  fusion,  network  information  theory,  tradeoffs  in 
local  vs  global  processing 

RCA-4:  Bounds  &  characteristics  of  algorithms  to  ID  minimum  resources  needed 
to  detect,  estimate,  track? 

RCA-5:  Fusion  Algorithms 

RCA-6:  Distributed  Algorithms  with  guarantees  on  global  behavior  (both  positive 
&  negative!) 

RCA-7:  Create  events/data  for  experiments  and  demos 

As  we  describe  in  Section  2,  our  research  has  resulted  in  significant  advances  across  the 
entire  intellectual  landscape  covered  by  these  ITs  and  RCAs.  Moreover,  while  our  research 
focuses  primarily  on  the  fundamental  mission  of  a  MURI  program-namely  the  investigation 
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of  foundational  issues  and  the  development  of  theories  and  methodologies  that  address  con¬ 
ceptual,  theoretical,  and  technological  barriers  to  realizing  the  vision  of  SensorWeb-we  also 
developed  partnerships  with  industry  and  DoD  to  produce  results  that  complement  and  are 
of  real  value  to  the  efforts  being  pursued  by  our  partners. 

1.2  Personnel  and  Infrastructure 

In  this  subsection  provide  some  factual  information  about  our  program.  In  the  next  subsec¬ 
tion  we  list  the  personnel  that  have  been  or  are  involved  in  our  efforts.  This  list  includes  17 
faculty  members;  8  post-doctoral  researchers,  research  scientists,  and  long-term  visitors;  and 
47  graduate  students.  A  glance  at  the  budget  for  this  grant  makes  it  clear  that  our  effort  has 
been  successfully  leveraged  with  a  considerable  level  of  additional  support,  mostly  through 
university  support  for  faculty  time  and  outside  fellowships  for  a  number  of  our  students. 
Moreover,  as  the  number  of  graduate  students  makes  clear,  we  have  been  extremely  success¬ 
ful  in  attracting  student  interest  and  in  fulfilling  the  very  important  educational  portion  of 
our  mission. 

Subsection  1.2.2  then  introduces  our  website,  which  contains  a  list  of  all  of  our  activities, 
including  not  only  all  of  the  publications  listed  in  Section  3  but  also  other  resources,  including 
other  papers  of  our  team  that  are  relevant  to  the  Sensor  Web  program;  listings  of  our  activities 
including  invited  talks,  seminars  and  internal  courses  and  seminars  that  we  have  developed; 
and  electronic  versions  of  a  number  of  our  presentations  and  invited  talks. 

1.2.1  Personnel 

The  principal  faculty  involved  in  this  research  program  were: 

MIT:  Prof.  Tommi  Jaakkola,  Prof.  Sanjoy  Mitter,  Prof.  John  Tsitsiklis,  Prof.  Alan  Will- 
sky  (PI) 

Princeton:  Prof.  Sanjeev  Kulkarni,  Prof.  Sergio  Verdu 
Illinois:  Prof.  P.R.  Kumar 

Additional  MIT  faculty  members  involved  in  this  research  program  are:  Prof.  Anantha 
Chandrakasan,  Prof.  David  Forney,  Prof.  Eric  Grimson,  Prof.  David  Staelin,  Prof.  Vincent 
Chan,  and  Prof.  Trevor  Darrell  (Profs.  Grimson,  Staelin,  Chan,  and  Darrell  do  not  require 
financial  support  from  this  program  but  are  involved  because  of  their  allied  research  activities 
that  provide  both  synergy  and  leverage  for  our  ongoing  activities). 

There  are  also  several  post-doctoral  researchers,  research  scientists,  and  visitors  involved 
in  our  research  program:  Dr.  Mujdat  Cetin  (working  primarily  with  Prof.  Willsky);  Dr. 
John  Fisher  (working  with  Profs.  Willsky,  Grimson,  and  Darrell);  Dr.  Reuben  Rabi  (work¬ 
ing  primarily  with  Prof.  Mitter);  Dr.  Martin  Wainwright  (working  with  Profs.  Willsky 
and  Jaakkola);  Dr.  Shic  Mannor  (working  primarily  with  prof.  Tsitsiklis),  Dr.  Liang-Liang 
Xie  (working  with  Prof.  Kumar);  Visiting  Professor  Hava  Siegelmann  (working  with  Profs. 
Jaakkola  and  Willsky)  and  Visiting  Scientist  Dr.  Robert  Washburn  (working  with  Prof. 
Willsky). 
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Undergraduate  students: 


1.  M.  Zhang,  MIT  (Willsky) 

Graduate  students: 

1.  Ashish  Agarwal,  Illinois  (MS  2004) 

2.  Girish  Baliga,  Illinois  (MS  2002) 

3.  Louay  Bazzi,  MIT  (Ph.D.  2003) 

4.  Haixiao  Cai,  Princeton  (Ph.D.  2005) 

5.  Min  Gao,  Illinois 

6.  Constantine  Caramanis,  MIT  (MS  2001,  Ph.D.  in  progress) 

7.  Aman  Chawla,  MIT 

8.  Lei  Chen,  MIT 

9.  Maurice  Chu,  MIT  (Ph.D.  2003) 

10.  Adrian  Corduneanu,  MIT  (MS  2002,  PhD  expected  2006) 

11.  Emily  Fox,  MIT  (MS  2005,  Ph.D.  in  progress) 

12.  Alvin  Fu,  MIT 

13.  Arvind  Giridhar,  Illinois  (MS  2002) 

14.  Major  Scott  Graham,  Illinois  (Ph.D.  2004) 

15.  Piyush  Gupta,  Illinois 

16.  Binita  Gupta,  Illinois  (MS  2002) 

17.  Nitin  Gupta,  Illinois  (MS  2004) 

18.  Kun  Huang,  Illinois  (Ph.D.  2004) 

19.  Alexander  Ihler,  MIT  (MS  2000,  Ph.D.  2005) 

20.  Ramesh  Johari,  MIT  (Ph.D.  2004) 

21.  Jason  Johnson,  MIT  (MS  2003) 

22.  V.  Kawadia,  Illinois 

23.  O.  Patrick  Kreicll,  MIT 

24.  Aurelie  Lozano,  Princeton 

25.  Dmitry  Malioutov,  MIT  (MS  2003) 

26.  Claire  Montcleoni,  MIT 

27.  Arnit  Nainani,  Illinois  (MS  2002) 

28.  Swetha  Narayanaswamy,  Illinois 

29.  Alex  Olshevsky,  MIT 


30.  Kurt  Plarre,  Illinois 

31.  Joel  Predd,  Princeton 

32.  R.J.  Radke,  Princeton 

33.  Alex  Reznik,  Princeton  (Ph.D.  2005) 

34.  R.  Rozovsky,  Illinois 

35.  S.  Sandilya,  Princeton 

36.  Roberto  Solis,  Illinois 

37.  Sung-Hyun  Son,  Princeton 

38.  Nathan  Srebro,  MIT  (Ph.D.  2004) 

39.  Erik  Sudderth,  MIT  (MS  2002) 

40.  Dewey  Tucker,  MIT 

41.  K.  Visweswariah,  Princeton 

42.  Martin  Wainwright,  MIT  (Ph.D.  2002) 

43.  Chin- Chun  Wang,  Princeton 

44.  Qing  Wang,  Princeton  (MS  2004) 

45.  Jason  Williams,  MIT 

46.  Yan  Wu,  Illinois  (MS  2003) 

47.  Feng  Xue,  Illinois 

1.2.2  Website 

As  we  have  indicated,  the  website  for  our  MURI  program,  the  home  page  of  which  is  displayed 
below,  contains  information  on  the  principals  involved  in  the  program  (including  links  to 
web  pages  appropriate  for  each),  on  research  efforts  associated  with  this  MURI,  on  onr 
industrial  partners  (with  links  to  their  pages),  on  publications  (including,  when  available, 
links  to  online  versions  of  papers  and  reports),  on  highlights  (including  seminars,  visits,  and 
publications/presentations  of  note),  and  other  available  resources. 

1.3  Activities,  Recognition,  and  Impact 

The  research  that  has  been  supported  under  this  MURI  program  and  which  is  highlighted  and 
summarized  in  Section  2,  has  resulted  in  a  considerable  number  of  successes  and  indictors  of 
excellence  and  impact.  While  we  have  not  hied  patents  or  made  formal  invention  claims,  the 
impact  of  our  work  and  its  recognition  as  path-breaking  are  substantial.  In  this  subsection 
we  summarize  these  indicators  of  recognition  and  impact  and  also  describe  many  of  our 
activities  in  support  of  our  research  and  its  broad  goal  of  having  an  impact  on  the  research 
and  DoD  communities. 
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Home  Welcome!  This  site  contains  information  on  the  SensorWeb  Multidisciplinary 

Research  Program  of  the  University  Research  Initiative  focused  on  data  fusion  for  large 
Abflutu?,  arrays  of  microsensors. 

Rge3rch  •  MURI  Principal  Researchers  and  Co- investigators 
p  hl.  t.  •  MURI  Graduate  and  Post-doctoral  Researchers 
F,Jbllcatlons  •  MURI  Affiliated  Organizations 

Eve nts/Hiah lights  •  Sponsor  Information 

This  Multidisciplinary  University  Research  Initiative  was  established  in  2000  with  the 
goal  of  providing  the  intellectual  foundations  for  distributed  data  and  information  fusion 
Search  among  large  arrays  of  microsensors.  We  are  supported  by  the  Department  of  Defense 
MURI  program  through  the  Army  Research  Office.  The  MURI  invokes  3  universities 
Pfitfate  and  numerous  researc  hers  and  students.  We  welcome  contacts  and  inquiries. 


Questions  and  comments  to  the  webmaster.  This  page  is  copyrighted  by  the  Massachusette  Institute  of 
Technology  and  dynamically  generated  on  Mon  day  April  16,  2001. 


http://se  nso  nwb  .mit  edu/index  .php 


4/16/2001 


Figure  1:  This  is  a  picture  of  our  website. 


1.3.1  Invited  Presentations,  Community  Leadership  and  Awards 

Our  team  has  been  extremely  active  in  presenting  our  work  at  conferences,  workshops,  and 
other  academic  and  industrial  organizations  and  in  taking  leadership  roles  in  organizing 
such  meetings.  Our  work  has  been  widely  recognized  within  the  broad  research  community, 
as  evidenced  by  the  numerous  invited  papers  and  talks,  several  of  which  are  keynote  and 
plenary  presentations,  and  the  many  important  awards  received  by  members  of  our  team. 
The  following  is  a  listing  of  these: 

1.  Graduate  student  Lei  Chen’s  work  on  data  association  for  multi-target  tracking  in 
sensor  networks  has  received  the  Best  Student  Paper  Award  at  the  2005  International 
Conference  on  Information  Fusion  held  in  Philadelphia,  Pennsylvania,  on  July  25-29, 
2005. 

2.  MIT  graduate  student  Emily  Fox  received  the  National  Defense  Science  and  Engi¬ 
neering  Graduate  Fellowship  from  the  Department  of  Defense  as  well  as  the  Graduate 
Research  Fellowship  from  the  National  Science  Foundation. 

3.  Emily  Fox  was  also  awarded  the  Department  of  Homeland  Security  Graduate  Fellow¬ 
ship  and  the  Bell  Labs  Graduate  Research  Fellowship. 

4.  Emily  Fox  won  the  Chorafas  thesis  award  granted  by  the  Chorafas  Foundation  for 
excellent  academic  performance  and  superior  contributions  in  research  as  a  Master  of 
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Engineering  student  and  the  David  Adler  Memorial  2nd  Place  Thesis  Prize  granted  by 
the  MIT  EECS  department  for  best  master’s  thesis  in  electrical  engineering. 

5.  MIT  graduate  student  Alex  Ihler  received  an  Outstanding  Student  Paper  Award  at 
the  2004  Neural  Information  Processing  Systems  (NIPS)  Conference 

6.  Alex  Ihlcr’s  work  on  self- calibration  in  sensor  networks  has  received  the  Best  Student 
Paper  Prize  at  the  2004  International  Symposium  on  Information  Processing  in  Sensor 
Networks,  held  in  Berkeley,  California,  on  April  26-27,  2004. 

7.  MIT  graduate  student  Adrian  Corduneanu  received  the  best  paper  award  at  the  18th 
Conference  on  Uncertainty  in  Artificial  Intelligence,  2002. 

8.  Prof.  Jaakkola  gave  an  invited  lecture  on  semi-supervised  learning  in  Stanford  Univer- 
sitys  Broad  Area  Colloquium,  January  2004. 

9.  Prof.  Kulkarni  was  elected  an  IEEE  Fellow,  2004. 

10.  Prof.  Kumar  received  2006  IEEE  Field  Award  in  Control  Systems. 

11.  Prof.  Kumar,  Keynote  Lecture  at  WCLC  2005,  Second  World  Congress  on  Lateral 
Computing,  Dec.  16-18th,  Bangalore,  India.  Bangalore. 

12.  Prof.  Kumar,  Keynote  Talk  at  ICISIP,  Third  International  Conference  on  Intelligent 
Sensing  and  Information  Processing ,  December  14-17,  2005,  Bangalore. 

13.  Prof.  Kumar,  Keynote  Talk  at  IFIP  Performance  2005 ,  October  3-7,  2005,  Juan  Les 
Pines,  France. 

14.  Prof.  Kumar,  Plenary  Talk  at  International  Symposium  on  Information  Theory  (ISIT), 
University  of  Adelaide,  South  Australia,  September  4-9,  2005.  Title:  Towards  a  theo¬ 
retical  foundation  for  wireless  and  sensor  networks. 

15.  Kurt  Plarre  and  P.R.  Kumar,  “Object  Tracking  by  Scattered  Directional  Sensors,”  (to 
appear  in:)  Proceedings  of  the  ffth  IEEE  Conference  on  Decision  and  Control,  Seville, 
Spain,  March  2,  2005. 

16.  Girish  Baliga  and  P.R.  Kumar,  “A  Middleware  for  Control  over  Networks,”  (to  appear 
in:)  Proceedings  of  the  ffth  IEEE  Conference  on  Decision  and  Control ,  Seville,  Spain, 
March  7,  2005. 

17.  Prof.  Kumar  gave  a  Plenary  Talk  at  39th  Annual  Asilomar  Conference  on  Signals, 
Systems,  and  Computers,  Pacific  Grove,  California,  October  30  -  November  2,  2005. 

18.  Prof.  Kumar,  Keynote  Speaker  at  WICON’05  First  International  Conference  on  Wire¬ 
less  Internet,  Budapest,  Hungary,  July  10-15,  2005. 

19.  Prof.  Kumar,  Keynote  Speaker  at  IFIP  Networking  2005  Conference,  University  of 
Waterloo,  Ontario,  Canada,  May  2-6,  2005. 
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20.  Prof.  Kumar  gave  a  Plenary  Talk  at  International  Symposium  on  Information  Theory 
(ISIT),  University  of  Adelaide,  South  Australia,  September  4-9,  2005.  Title:  Towards 
a  theoretical  foundation  for  wireless  and  sensor  networks. 

21.  Prof.  Kumar,  Plenary  Panel  Member  at  43rd  IEEE  Conference  on  Decision  and  Con¬ 
trol,  Paradise  Island,  Bahamas,  December  14-17,  2004. 

22.  Prof.  Kumar  gave  an  Invited  Talk  at  ACM  SenSys  ’04,  Baltimore,  MD,  November  3-5, 
2004. 

23.  Prof.  Kumar  gave  a  Plenary  Talk  at  2004  IEEE  Information  Theory  Workshop,  San 
Antonio,  TX,  October  24-29,  2004. 

24.  Prof.  Kumar  gave  the  Plenary  Talk  at  The  7th  Informs  Telecommunication  Conference, 
March  710,  2004,  Boca  Raton, Florida. 

25.  Prof.  Kumar  gave  the  Plenary  Talk  at  IEEE  TENCON’2003,  October  15-17,  2003, 
Bangalore,  India. 

26.  Prof.  Kumar  gave  the  Keynote  Talk  at  PWC  2003:  The  Eighth  International  Confer¬ 
ence  on  Personal  Wireless  Communications,  September  23-24,  2003,  Venice,  Italy. 

27.  Prof.  Kumar  gave  the  Plenary  Talk  at  The  2nd  International  Workshop  on  Information 
Processing  in  Sensor  Networks  (IPSN  ’03),  April  22-23,  2003,  Palo  Alto,  California, 
USA. 

28.  Prof.  Kumar  gave  the  Plenary  Talk  at  WiOpt’03:  Modeling  and  Optimization  in  Mobile 
and  Ad  Hoc  and  Wireless  Networks,  March  3-5,  2003,  Sophia- Antipolis,  France. 

29.  Prof.  Kumar  gave  the  Plenary  Talk  at  Annual  Workshop  On  Mobile  Information  and 
Communication  Systems,  February  13,  2003,  ETH,  Zurich,  Switzerland. 

30.  Prof.  Kumar  gave  the  Plenary  Talk  at  the  10th  Mediterranean  Conference  on  Control 
and  Automation,  Lisbon,  Portugal,  July  913,  2002. 

31.  Prof.  Kumar  gave  the  Plenary  Talk  at  the  German  Open  Conference  on  Probability 
and  Statistics,  Magdeburg,  March  19-22,  2002. 

32.  Prof.  Kumar  gave  the  Keynote  Talk  at  the  Stochastic  Theory  and  Control  Workshop, 
Lawrence,  KS,  Oct  1820,  2001. 

33.  Prof.  Kumar  gave  the  Keynote  Talk  at  SPIE’s  ITCom  2001  -  International  Sympo¬ 
sium  and  Exhibit  on  the  Convergence  of  Information  Technology  and  Communications: 
Modeling  and  Design  of  Wireless  Networks.  Title  of  Talk:  Three  protocols  for  MAC, 
Power  Control,  and  Routing  in  wireless  networks  Denver,  August  23-24,  2001. 

34.  Prof.  Kumar  gave  the  Plenary  Talk  at  the  2001  SIAM  Annual  Meeting,  San  Diego, 
July  1114,  2001. 

35.  Prof.  Kumar  served  on  the  Editorial  Board,  ACM  Transactions  on  Sensor  Networks, 
2004-2005. 
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36.  Prof.  Kumar  served  as  the  Editor,  Communications  in  Information  and  Systems,  1999-. 

37.  Prof.  Kumar  served  on  the  Editorial  Board  of  Journal  of  Discrete  Event  Dynamic 
Systems:  Theory  and  Applications,  January  1993. 

38.  Prof.  Kumar  served  as  the  Associate  Editor  of  Mathematics  of  Control,  Signals,  and 
Systems,  1986-3 

39.  Prof.  Kumar  served  as  the  Associate  Editor  of  Mathematical  Problems  in  Engineering: 
Theory,  Methods  and  Applications,  1995. 

40.  Prof.  Kumar  served  as  the  General  Chair,  The  ACM  Symposium  on  Mobile  Ad  Hoc 
Networking  and  Computing,  MobiHoc  2005,  Chicago,  USA. 

41.  Prof.  Kumar  served  on  the  Technical  Program  Committee  for  the  2006  IEEE  Interna¬ 
tional  Symposium  on  Information  Theory,  Seattle. 

42.  Prof.  Kumar  served  on  the  Technical  Program  Committee  of  SECON  2004  -  The  First 
IEEE  International  Conference  on  Sensor  and  Ad  hoc  Communications  and  Networks, 
Santa  Clara,  CA,  Oct  4-7,  2004. 

43.  Prof.  Kumar  served  as  the  Moderator  of  the  Panel  on  Sensor  Networks  at  IPSN  2004, 
April  25-27,  2004,  Berkeley,  CA. 

44.  Prof.  Kumar  served  on  the  International  Advisory  Committee  of  International  Con¬ 
ference  on  Signal  Processing  and  Communications  (SPCOM-2004),  Dec.  1114,  2004. 
Bangalore,  India. 

45.  Prof.  Kumar  served  on  the  Technical  Program  Committee  for  Mobile  and  Wireless 
Computing  Track  of  International  Conference  for  Parallel  and  Distributed  Systems 
(ICPADS),  July  79,  2004,  Newport  Beach. 

46.  Prof.  Kumar  served  on  the  Technical  Program  Committee  for  SenSys  2004,  the  Sec¬ 
ond  ACM  Conference  on  Embedded  Networked  Sensor  Systems.  November  35,  2004, 
Baltimore,  MD,  USA. 

47.  Prof.  Kumar  served  on  the  ACM  Symposium  on  Mobile  Ad  Hoc  Networking  and  Com¬ 
puting,  MobiHoc  2004  Technical  Program  Committee.  Tokyo,  Japan. 

48.  Prof.  Kumar  served  on  the  Technical  Program  Committee  of  Workshop  on  Modeling 
and  Optimization  in  Mobile  and  Ad  Hoc  Networks  (WiOpt’04). 

49.  Prof.  Kumar  served  on  the  Steering  Committee  of  Information  Processing  in  Sensory 
Networks  (IPSN),  2003-. 

50.  Prof.  Kumar  served  on  the  ACM  MobiCom  2003  Technical  Program  Committee.  Sep 
14-19,  2003.  June  1-3,  2003  Annapolis,  Maryland. 

51.  Prof.  Kumar  served  on  the  IFAC  Technical  Committee  on  Stochastic  Systems  (TC-SS), 
2002. 
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52.  Prof.  Kumar  served  on  the  2004  IEEE  International  Symposium  on  Information  Theory 
Technical  Program  Committee,  Chicago,  IL,  June  27  to  July  2,  2004. 

53.  Prof.  Kumar  served  on  the  ACM  Symposium  on  Mobile  Ad  Hoc  Networking  and 
Computing,  MobiHoc  2003  Technical  Program  Committee.  June  1-3,  2003  Annapolis, 
Maryland. 

54.  Prof.  Kumar  served  on  the  International  Technical  Program  Committee  for  the  2003 
IEEE  International  Conference  on  Communications  (ICC),  Anchorage,  Alaska,  May 
1115,  2003. 

55.  Prof.  Kumar  served  on  the  International  Program  Committee  for  the  10th  Mediter¬ 
ranean  Conference  on  Control  and  Automation,  Lisbon,  Portugal,  July  912,  2002. 

56.  Prof.  Kumar  served  on  the  International  Program  Committee,  IFAC  Workshop  on 
Adaptation  and  Learning  in  Control  and  Signal  Processing,  Cernobbio-Como,  Italy, 
August  2931,  2001. 

57.  Prof.  Kumar  served  on  the  International  Program  Committee  for  10th  Mediterranean 
Conference  on  Control  and  Automation,  Lisbon,  Portugal,  July  912,  2002 

58.  Prof.  Kumar  served  as  the  Chair  of  the  Organizing  Committee  for  “Workshop  on 
Wireless  Networks,”  Institute  for  Mathematics  and  its  Applications,  Minneapolis,  Aug 
610,  2001. 

59.  Prof.  Mitter  was  awarded  the  Russell- Severance- Springer  Chair,  Dept,  of  Electrical 
Engineering  &  Computer  Science,  University  of  California,  Berkeley,  CA.  (9/2003) 

60.  Prof.  Mitter  became  a  Foreign  Member  of  the  Istituto  Veneto  di  Scienze,  Lettere  ed 
Arti  (2003) 

61.  Sergio  Verdu  received  was  awarded  a  Doctor  Honoris  Causa  degree  by  the  Polytechnic 
University  of  Catalonia,  Barcelona,  Spain,  2005. 

62.  Sergio  Verdu  received  the  2002  Leonard  G.  Abraham  Prize  Award,  IEEE  Communi¬ 
cations  Society. 

63.  Sergio  Verdu  was  Plenary  Lecturer  at  the  2002  IEEE  Int.  Symposium  on  Information 
Theory,  Lausanne,  Switzerland,  June  2002. 

64.  Sergio  Verdu  received  the  Japan  Telecommunications  Advancement  Foundation  Paper 
Award  in  2000. 

65.  Sergio  Verdu  received  the  2000  Frederick  Emmons  Terman  Award  from  the  American 
Society  of  Engineering  Education. 

66.  Sergio  Verdu  is  plenary  lecturer  of  LATIN  2006,  (Latin  America  Theoretical  Informat¬ 
ics,  2006),  Valdivia,  Chile,  March  2006. 

67.  Sergio  Verdu  gave  a  Keynote  Talk  at  the  New  Frontiers  of  Multiuser  Detection  Work¬ 
shop,  U.  S.  Air  Force  Research  Laboratory,  Rome,  NY,  June  20-22,  2005. 
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68.  Sergio  Verdu  gave  a  Keynote  Talk  at  SPWC2005:  Signal  Processing  in  Wireless  Com¬ 
munications  Conference.  King’s  College,  London,  UK,  June  13-15,  2005. 

69.  Sergio  Verdu  gave  an  Invited  Talk  at  the  The  First  Kailath  Lecture  and  Colloquium, 
Stanford  University,  Stanford,  CA,  June  10-11,  2005. 

70.  Sergio  Verdu  gave  a  Keynote  Talk  at  2005  IEEE  Workshop  on  Signal  Processing  Ad¬ 
vances  in  Wireless  Communications,  New  York,  NY,  June  5-8,  2005. 

71.  Sergio  Verdu  gave  a  Keynote  Talk  at  2005  Viterbi  Conference:  Advancing  Technology 
through  Communications  Sciences,  March  8-9,  2005. 

72.  Sergio  Verdu  gave  the  Distinguished  IEEE  Communications  Society  Lecture,  IEEE 
Singapore  Chapter  of  Communications  Society,  National  University  of  Singapore,  Sin¬ 
gapore,  Dec.  20,  2004. 

73.  Sergio  Verdu  gave  the  Distinguished  IEEE  Communications  Society  Lecture,  IEEE 
Hong  Kong  Chapter  of  Circuits  and  Systems  and  Communications  Societies,  City 
LIniversity  of  Hong  Kong,  Hong  Kong  SAR,  China,  Dec.  17,  2004. 

74.  Sergio  Verdu  gave  the  Distinguished  IEEE  Communications  Society  Lecture,  Tsinghua 
University,  Beijing,  China,  Dec.  15,  2004. 

75.  Sergio  Verdu  gave  a  Keynote  Talk  at  2004  PIMRC:  15th  IEEE  Int.  Syrnp.  on  Personal, 
Indoor  and  Mobile  Radio  Communications,  Barcelona,  Spain,  Sep.  5-8,  2004. 

76.  Sergio  Verdu  gave  an  Invited  Plenary  Talk,  2nd  International  Workshop  on  Signal 
Processing  for  Wireless  Communications  2004,  London,  LIK,  2nd  -  4th  June  2004. 

77.  Sergio  Verdu  gave  an  Invited  Keynote  Address,  2004  International  Zurich  Seminar  on 
Communications  (IZS),  ETH  Zurich,  Switzerland,  Feb.  18-20,  2004. 

78.  Sergio  Verdu  gave  the  joint  MSRI-Evans  Plenary  talk  at  Mathematics  Department, 
University  of  California,  Berkeley,  CA,  Feb.  25,  2002. 

79.  Sergio  Verdu  serves  as  Member  of  the  International  Advisory  Committee,  Ninth  Inti. 
Symp.  Spread  Spectrum  Techniques  and  Applications,  Manaus,  Brazil,  2006. 

80.  Sergio  Verdu  serves  as  Member  of  the  Program  Committee,  2006  IEEE  Int.  Symp.  on 
Information  Theory,  Seattle,  WA,  July  2006. 

81.  Sergio  Verdu  serves  as  Member  of  the  Program  Committee  and  Invited  Session  Orga¬ 
nizer,  2006  IEEE  Workshop  on  Information  Theory,  Punta  del  Este,  LIruguay,  March 
2006. 

82.  Sergio  Verdu  serves  as  Member  of  the  Scientific  Advisory  Board,  Telefonica  I+D,  2005- 
present. 

83.  Sergio  Verdu  serves  as  Member  of  the  Technical  Advisory  Board,  Flarion  Technologies, 
2000-present. 
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84.  Sergio  Verdu  serves  as  Member  of  the  Advisory  Board,  Australian  Telecommunications 
Research  Network,  2004-present. 

85.  Sergio  Verdu  was  named  Distinguished  Lecturer,  IEEE  Communications  Society,  2004. 

86.  Sergio  Verdu  served  as  Member  of  the  Program  Committee,  2005  IEEE  Int.  Syrnp.  on 
Information  Theory,  Adelaide,  Australia,  September  2005. 

87.  Sergio  Verdu  was  Co-Chair  of  the  2004  IEEE  Workshop  on  Information  Theory,  San 
Antonio,  Oct.  24-29,  2004. 

88.  Sergio  Verdu  served  as  Member  of  the  Technical  Program  Committee,  2004  Interna¬ 
tional  Symposium  on  Information  Theory  and  Applications  (ISITA04),  Parma,  Italy, 
Oct.  2004. 

89.  Sergio  Verdu  served  as  Co-Editor,  Special  Issue  of  IEEE  Journal  on  Selected  Areas  on 
Communications  on  “Fundamental  Performance  Limits  of  Wireless  Sensor  Networks,” 
vol.  22,  no.  6,  Aug.  2004. 

90.  Sergio  Verdu  served  as  Member  of  the  Program  Committee,  2004  IEEE  Int.  Syrnp.  on 
Information  Theory,  Chicago,  IL,  June  2004. 

91.  Sergio  Verdu  served  as  Co-organizer,  “Information  Theory  of  Wireless  Ad  Hoc  Net¬ 
works”  session,  2004  International  Zurich  Seminar  on  Communications  (IZS),  ETH 
Zurich,  Switzerland,  Feb.  18-20,  2004. 

92.  Sergio  Verdu  serves  as  Editor-in-chief,  Foundations  and  Trends  in  Communications 
and  Information  Theory,  2003-present. 

93.  Sergio  Verdu  served  as  Member  of  the  Program  Committee,  2003  Communication 
Technology  Alliance  Annual  Symposium,  April  29  -  May  1,  2003. 

94.  Sergio  Verdu  served  as  Member  of  the  Program  Committee,  2003  IEEE  Information 
Theory  Workshop,  Paris,  France,  March  31-  Apr.  4,  2003. 

95.  Sergio  Verdu  serves  as  Associate  Editor  for  Book  Reviews,  IEEE  Transactions  on  In¬ 
formation  Theory,  2002-present 

96.  Sergio  Verdu  served  as  Co-Chair,  DIMACS  Distinguished  Princeton-Rutgers  Seminar 
Series  in  Communications  and  Information  Theory,  2002-2003. 

97.  Sergio  Verdu  served  as  Chair,  2002  MSRI  Workshop  on  Information  Theory,  Mathe¬ 
matical  Sciences  Research  Institute,  Berkeley,  Feb.  25  -  Mar.  1,  2002. 

98.  Sergio  Verdu  served  as  Member  of  the  Nominations  Committee,  IEEE  Information 
Theory  Society,  2001,  2005. 

99.  Sergio  Verdu  served  as  Chair,  2001  Frederick  E.  Terman  Award  Committee,  American 
Society  for  Engineering  Education. 
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100.  Sergio  Verdu  was  elected  Distinguished  Lecturer,  IEEE  Communications  Society,  2001- 
2002. 

101.  Sergio  Verdu  served  as  Member  of  the  Program  Committee,  2001  IEEE  Int.  Syrnp.  on 
Information  Theory,  Washington,  DC,  June  2001. 

102.  Sergio  Verdu  served  as  Member  of  the  Organizing  Committee,  DIMACS  Special  Focus 
on  Computational  Information  Theory  and  Coding,  2000-2002. 

103.  Sergio  Verdu  served  as  Member  of  the  IEEE  Hamming  Medal  Committee,  2000-2004. 

104.  Sergio  Verdu  served  as  Co-Chair,  2000  IEEE  Int.  Syrnp.  on  Information  Theory. 
Sorrento,  Italy,  June  2000. 

105.  Sergio  Verdu  serves  as  Editor  of  Communications  in  Information  and  Systems,  2000- 
present. 

106.  Sergio  Verdu  served  as  Organizer,  Session  on  Turbo  Multiuser  Detection,  IEEE  Sixth 
International  Syrnp.  on  Spread  Spectrum  Techniques  and  Applications,  Parsippany, 
NJ  Sep.  6-8,  2000. 

107.  Sergio  Verdu  served  as  Member  of  the  Technical  Program  Committee  and  International 
Advisory  Committee,  IEEE  Sixth  International  Syrnp.  on  Spread  Spectrum  Techniques 
and  Applications,  Parsippany,  NJ  Sep.  6-8,  2000. 

108.  Prof.  Willsky  recently  received  an  honorary  doctorate  from  the  Lhhversity  of  Rennes  in 
France  as  part  of  the  25th  anniversary  of  IRISA  —  a  joint  INRIA,  CNRS  Laboratory, 
2005. 

109.  Prof.  Willsky  was  recently  named  the  recipient  of  the  2004  IEEE  Donald  G.  Fink  Prize 
Paper  Award  for  his  paper  “Multiresolution  Markov  Models  for  Signal  and  Image 
Processing.” 

110.  Prof.  Whisky’s  group  was  invited  to  contribute  a  paper  describing  our  work  on  dis¬ 
tributed  data  association  in  sensor  networks  to  Mathematical  and  Computer  Modeling, 
Special  Issue  on  Optimization  and  Control  for  Military  Applications. 

111.  Prof.  Willsky  has  recently  served  on  the  Air  Force  Scientific  Advisory  Board. 

112.  Prof.  Willsky  has  been  chosen  by  Washington  Lhhversity  (St.  Louis)  as  the  2006 
John  Zaborszky  Lecturer  and  in  February  2006  he  will  deliver  a  series  of  lectures  on 
Graphical  Models  and  Distributed  Fusion  in  Sensor  Networks. 

113.  Prof.  Willsky  has  been  invited  as  a  Distinguished  Speaker  by  the  Lhhversity  of  Michigan 
and  will  be  lecturing  on  Distributed  Fusion  in  Sensor  Networks  in  February  2006. 

114.  Prof.  Willsky  has  been  invited  to  speak  in  Stanford  Lhiiversity’s  Broad  Area  Collo¬ 
quium,  and  he  will  lecture  on  Distributed  fusion  in  Sensor  Networks  in  May  2006. 
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1.3.2  Interactions  and  Transitions 


We  have  also  been  extremely  active  in  pursuing  interactions  with  others  in  academia,  in¬ 
dustry,  and  DoD.  Many  of  these  interactions,  including  some  of  the  presentations  listed  in 
the  preceding  subsection,  are  documented  on  the  website,  although  others  have  been  more 
pervasive  and  continuing  are  not  called  out  as  “highlights”  or  “events”. 

In  this  subsection  we  highlight  some  of  these  interactions,  dividing  them  into  those  in¬ 
volving  other  academic  activities  and  those  involving  industry  and  DoD. 

Academic  Interactions 

(1)  One  of  the  most  substantive  interaction  has  been  with  the  parallel  MURI  on  Decision- 
Making  Under  Uncertainty  led  by  Profs.  Michael  Jordan  of  Berkeley  and  Daphne  Roller 
of  Stanford,  which  also  involves  interactions  with  the  SensIT  activities  at  Berkeley. 
This  interaction  has  included  numerous  short  and  longer  term  reciprocal  visits.  Visits 
from  Berkeley  to  MIT  include  those  by  Dr.  Sekhar  Tatikonda  (who  was  a  post-doctoral 
fellow  at  Berkeley  after  finishing  his  Ph.D.  under  Prof.  Mitter’s  supervision  at  MIT 
and  supported  under  this  MURI),  Prof.  Michael  Jordan,  Prof.  Laurent  El-Ghaoui, 
Prof.  Kannan  Ramchandran,  and  Prof.  Martin  Wainwright  (formerly  a  Ph.D.  student 
of  Prof.  Willsky’s  supported  under  this  MURI,  and  subsequently  a  post-doctoral  fellow 
and  now  faculty  member  at  UC  Berkeley).  Visits  from  MIT  to  Berkeley  include  several 
by  Prof.  Willsky,  an  extended  visit  by  Prof.  Verclu  and  by  Prof.  Mitter,  who  held  the 
Berkeley  Russell- Severance- Springer  Chair  at  Berkeley  during  his  visit. 

(2)  Interaction  with  the  MLIRI  on  Battlefield  Visualization,  primarily  through  our  group 
at  MIT  and  Prof.  Praruod  Varshney  of  Syracuse  University. 

(3)  The  continuation  of  a  long-standing  interaction  and  collaboration  with  Prof.  Randy 
Moses  of  Ohio  State  University,  who  has  had  several  extended  visits  to  MIT  and  with 
whom  we  have  collaborated  in  several  areas.  The  most  significant  of  these  is  in  the 
area  of  sensor  location  estimation,  an  area  in  which  Prof.  Moses  has  been  working 
with  ARL  (in  particular  with  Dr.  N.  Srour)  under  the  Sensors  Collborative  Technoligy 
Alliance.  This  collaboration  has  led  to  new  distributed  algorithms,  developed  by  Dr. 
Alexander  Ihlcr  (Prof.  Willsky  and  Dr.  Fisher’s  student),  which  have  been  recognized 
with  a  Best  Paper  Award  as  listed  previously. 

(4)  All  of  the  faculty  members  of  our  research  team  continue  to  play  active  leadership 
roles  in  the  broader  research  community,  including  editorial  positions  on  numerous 
journals,  service  on  IEEE  committees,  and  participation  in  program  committees  of 
major  national  and  international  meetings. 

Industrial  and  DoD  Interactions  and  Transitions 

The  following  represent  the  major  interactions  and  transitions  in  which  we  have  been 
involved: 
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(1)  Long-standing  interactions  with  Dr.  Feng  Zhao  (formerly  at  PARC  and  now  at  Mi¬ 
crosoft  Research),  who  was  funded  initially  through  DARPA’s  SensIT  program,  and 
Dr.  Maurice  Chu,  who  completed  his  Ph.D.  at  MIT  supported  under  this  program  and 
then  joined  PARC  where  he  leads  research  on  sensor  networks  for  target  tracking  and 
other  applications. 

(2)  Continuing  transitions  and  interactions  with  several  programs  led  by  BAE  Systems 
Advanced  Information  Technologies  (BAE-AIT,  formerly,  ALPHATECH,  Inc.).  These 
include: 

a.  Transition  of  our  network-constrained  fusion  algorithms  to  efforts  in  support  of 
acoustic/seismic  sensor  fusion  for  multitarget  tracking  in  the  Army’s  Raptor  pro¬ 
gram. 

b.  Transition  of  our  distributed  fusion  algorithms  as  part  of  efforts  under  DARPA’s 
Dynamic  Tactical  Targeting  program. 

c.  Transition  of  Dr.  Fisher’s  information-theoretic  methods  for  heterogeneous  sensor 
fusion  to  programs  in  feature-aided  tracking,  DARPA’s  program  in  Integrated 
Sensing  and  Processing  (on  which  both  Dr.  Fisher  and  Prof.  Willsky  are  con¬ 
sultants),  and  to  several  programs  involving  multi-sensor  information-theoretic 
fusion  including  DARPA’s  Combat  Zones  that  See  program. 

d.  Transition  of  our  very  recently  developed  methods  for  scalable,  distributed  algo¬ 
rithms  for  multi-target  tracking  to  several  programs  including  DARPA’s  Net  Track 
program. 

e.  Transition  of  our  highly  scalable  inference  algorithm  to  so-called  “link  discovery” 
programs  at  Alphatech  (for  DARPA,  NIMA,  NSA,  and  other  agencies).  These 
are  very  large-scale  inference  problems  involving  identifying  relationships  among 
very  large  sets  of  sensed  signals  and  events. 

f.  Transition  of  our  computationally  efficient  fusion  algorithms  for  battlefield  envi¬ 
ronment  estimation  (e.g.,  terrain,  road  networks,  trafficability,  weather,  etc.) 

(3)  Continuing  interactions  with  Lincoln  Laboratory,  including: 

a.  A  continuing  series  of  seminars,  both  at  MIT  by  Lincoln  researchers  and  by  Prof. 
Willsky,  Dr.  Fisher,  and  their  students  at  Lincoln  Laboratory. 

b.  Transition  of  our  methods  for  scalable  networked  inference  to  a  variety  of  programs 
at  Lincoln  including  one  on  bio-chem  sensor  networks. 

c.  Summer  positions  for  Ms  Emily  Fox,  Prof.  Willsky  and  Dr.  Fisher’s  student. 

d.  Transition  of  our  research  on  information-theoretic  sensor  resource  management. 

e.  Regular  participation  in  Lincoln’s  Adaptive  Array  and  Signal  Processing  Sympo¬ 
sium. 

(4)  Interactions  with  ARL  and  AR.L’s  CTA  programs,  including: 
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a.  Interactions  with  the  Senior  CTA.  One  significant  component  of  this  interaction  is 
our  collaboration  with  Prof.  Randy  Moses  of  Ohio  State.  As  mentioned  previously, 
this  includes  combining  our  complementary  work  on  sensor  location  estimation 
and  on  algorithms  that  are  robust  to  sensor  location  errors  as  well  as  using  our 
methods  for  network-constrained  estimation  as  the  basis  for  distributed  versions 
of  Prof.  Moses’  sensor  location  estimation  algorithms. 

b.  An  extended  visit  by  Alexander  Ihler  to  ARL  to  work  with  Dr.  Brian  Sadler  and 
Mr.  Tien  Pham.  This  visit  inspired  much  of  Dr.  Ihlcr’s  subsequent  Ph.D.  research, 
for  which  he  has  received  several  Best  Paper  awards. 

c.  Collaborative  research  involving  Dr.  Brian  Sadler  of  ARL  and  Dr.  Mujdat  Cetin 
of  MIT.  This  work,  on  sparse  channel  identification,  was  inspired  directly  by  Dr. 
Cetin  and  his  student  Dmitry  Malioutov’s  work  on  the  use  of  so-called  “sparsity 
priors”  for  new,  robust  methods  for  super-resolved  source  localization. 

d.  Sergio  Verdu  is  a  participating  investigator  in  the  CTA-ARL  Communications 
and  Networking  Consortium  led  by  Telcordia. 

(5)  ARO  activities,  including: 

a.  Prof.  Kumar’s  participation  as  a  panel  member  in  the  Triennial  Research  Strategy 
Planning  Workshop  for  ARO’s  Computing  and  Information  Sciences  Division, 
Charleston,  SC. 

b.  Prof.  Kumar’s  role  as  a  member  of  the  Board  of  Visitors  for  the  Program  Review 
of  6.1  ARL- ARO  Mathematics  Division,  Research  Triangle  Park,  NC,  May  2001. 

c.  Dr.  Wainwright’s  invited  talk  at  the  2002  Army  Statistics  Meeting  (in  a  session 
organized  by  Dr.  Wendy  Martinez  of  ONR). 

d.  The  development  at  ARO  of  an  SBIR  topic  inspired  directly  by  the  research  of 
Dr.  John  Tsitsiklis  of  MIT. 

(6)  AFIT 

Major  Scott  R.  Graham,  Air  Force,  Air  Force  Institute  of  Technology,  obtained  his 
Ph.D.  under  the  guidance  of  Prof.  P.R.  Kumar  at  the  LIniv.  of  Illinois.  Title  of  Ph.D. 
Thesis:  “Issues  in  the  Convergence  of  Control  with  Communication  and  Computation,” 
2004. 

Dr.  Graham  is  setting  up  a  laboratory  at  AFIT  based  on  Prof.  P.R.  Kumar’s  Conver¬ 
gence  Laboratory  at  the  LIniv.  of  Illinois. 


2  Research  Highlights 

In  this  section  we  provide  a  summary  of  highlights  of  our  research  activities.  For  obvious 
reasons  our  descriptions  will  be  very  brief  and  also  represent  only  a  partial  look  at  our 
research  accomplishments.  We  refer  the  reader  to  our  web  site,  our  publications,  and  to 
previous  interim  reports  and  annual  briefings  for  a  much  more  complete  look  at  our  research. 
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(1)  Motivated  in  large  part  by  our  research  on  message-passing  algorithms  and  in  particular 
by  our  work  on  sensor  localization,  we  have  developed  a  considerable  generalization 
of  particle  filtering  applicable  to  problems  of  inference  on  graphs  with  cycles.  This 
new  class  of  Nonparametric  Belief  Propagation  (NBP)  algorithms  has  not  only  been  of 
great  value  in  our  research  program  but  it  also  has  already  been  widely  used  by  others 
in  a  wide  variety  of  applications.  A  software  package  for  NBP  is  available  on  the  web. 

(2)  One  of  the  most  significant  applications  of  NBP  was  to  the  problem  of  distributed 
processing  for  localization  of  all  of  the  sensors  in  a  sensor  network.  The  resulting 
algorithm  is  capable  of  dealing  with  the  multimodal  uncertainty  that  characterizes 
this  problem  and  with  outliers,  resulting  in  a  very  powerful  algorithm.  A  paper  on  this 
work  received  a  best  paper  award. 

(3)  Motivated  by  the  need  for  limiting  communication  in  power-constrained  sensor  net¬ 
works,  we  have  developed  a  new  method  of  error  analysis  in  belief  propagation  in  order 
to  assess  the  effect  on  overall  fusion  performance  of  quantization,  censoring,  and  ap¬ 
proximation  of  distributed  inference  likelihood  function  messages  from  one  sensor  to 
another.  Using  a  new  measure  of  error,  we  have  developed  this  tool  which  also  pro¬ 
vided  the  basis  for  the  tightest  known  conditions  for  convergence  of  distributed  belief 
propagation  algorithms.  A  paper  on  this  work  received  a  best  paper  award. 

(4)  Similar  motivation  provided  the  basis  for  our  investigation  of  effective  methods  for 
transmitting  particle-based  messages  as  occur  in  NBP  or  in  any  other  message  passing 
algorithm.  By  exploiting  a  protocol  that  is  also  used  for  efficiency  in  NBP  —  namely 
a  multiresolution  organization  of  particle-based  messages  and  the  caching  of  statistics 
at  each  node  in  this  multiresolution  tree  —  we  have  developed  a  very  flexible  and 
efficient  methodology  both  for  the  efficient  coarse-to-foie  transmission  of  particle-based 
messages  and  for  the  computation  of  the  message  error  introduced  if  only  coarser 
resolutions  of  these  messages  are  transmitted.  This  provides  a  direct  tie  between 
communication  requirements  and  message  error,  which,  when  combined  with  our  work 
in  (3)  above,  provides  the  first  audit  trail  from  communication  constraints  to  overall 
fusion  performance,  as  well  as  a  fully  adaptive  algorithm  in  which  each  node  can  assess 
the  tradeoff  between  the  new  information  it  has  to  transmit  and  the  communication 
cost  of  doing  so. 

(5)  We  have  developed  very  powerful  theoretical  results  on  message-passing  algorithms 
such  as  belief  propagation.  A  rich  set  of  these  exploit  the  presence  of  (many)  em¬ 
bedded  spanning  trees  within  a  loopy  network  graph.  This  leads  to  the  framework 
of  tree-reparameterization,  which  we  have  exploited  in  numerous  ways,  including:  (a) 
using  convex  analysis  to  prove  the  existence  of  fixed  points  to  belief  propagation  (BP) 
algorithms  and  to  provide  bounds  on  the  errors  in  BP  algorithms  —  i.e.,  on  the  dif¬ 
ference  between  the  fusion  results  of  suboptimal,  but  scalable  BP  algorithms  and  the 
truly  optimal  answers  (which  cannot  be  computed  in  general  in  a  scalable  manner); 
(b)  the  development  of  tree-reweighting  algorithms  that  again  exploit  convexity  both 
to  allow  efficient  computation  of  the  bounds  just  mentioned  and  also  to  provide  truly 
optimal,  distributed  solutions  to  the  problem  of  hireling  the  maximum  a  posteriori  es¬ 
timate  (i.e.,  the  global  configuration  over  all  nodes  in  the  network  that  has  maximum 
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posterior  probability).  These  results  have  led  to  two  best  paper  and  one  best  thesis 
award  and  have  also  provided  the  basis  for  other  areas  of  our  research  (and  in  particular 
our  work  on  distributed  multi-target  data  association  and  tracking). 

(6)  For  the  case  of  Gaussian  fusion  in  sensor  networks,  we  have  provided  a  new  and  very 
powerful  interpretation  of  BP  algorithms.  In  particular,  we  have  provided  a  so-called 
walk-sum,  interpretation  of  the  computations  for  estimates  and  error  covariances  in 
BP  —  an  approach  that  involves  careful  examination  of  the  propagation  and  fusion  of 
information  through  multiple  stages  of  message  passing  and  fusion  processing.  This 
analysis  provides  the  basis  for  the  best  known  sufficient  (and  almost  necessary)  con¬ 
ditions  for  BP  convergence  for  such  problems  plus  a  clear  picture  of  the  sources  of 
suboptimality  in  the  BP  computations  of  error  covariances. 

(7)  We  have  developed  a  rich  array  of  new,  general  purpose  network  fusion  algorithms 
each  of  which  satisfies  two  critical  requirements:  (a)  scalability  to  very  large  networks 

-  which  generally  means  that  the  computational  load  per  sensor  is  independent  of 
network  size;  and  (b)  true  optimality  or  at  worst  tight  control  over  nearness  to  op¬ 
timality.  One  of  these  approaches  is  the  class  of  Embedded  Trees  (ET)  algorithms 
for  Gaussian  models.  These  iterative  algorithms  involve  computations  on  embedded 
tractable  subnetworks  (e.g.,  trees)  followed  by  injection  of  corrections  due  to  the  graph 
edges  that  were  “cut”  in  the  preceding  stage  (i.e.,  the  edges  not  included  in  the  em¬ 
bedded  tractable  structure).  ET  algorithms  have  been  demonstrated  to  have  very  fast 
convergence  and  also  yield  the  true,  optimal  error  covariances  for  rich  classes  of  models. 

(8)  Another  very  powerful  set  of  network  fusion  algorithms  falls  under  the  heading  of  what 
refer  to  as  Recursive  Cavity  Modeling  (RCM).  The  basic  concept  of  RCM  algorithms  is 
that  of  fusing  information  radially  outward  from  sets  of  “seed”  nodes,  producing  models 
around  the  boundaries  of  radially  increasing  cavities  centered  on  each  of  these  seeds; 
fusing  the  cavities  as  their  boundaries  meet;  and  then  completing  the  fusion  process  by 
processing  information  radially  inward  toward  the  seed  nodes.  If  no  approximations 
are  made,  this  approach  yields  truly  optimal  solutions;  however,  scalability  requires 
approximations.  Specifically,  at  each  stage  of  propagation  of  a  boundary  outward 
or  inward,  the  exact  statistical  model  corresponds  to  a  very  dense  (often  completely 
connected)  graph.  The  approximation  that  must  be  made  is  to  thin  this  model  so 
that  tractable  inference  can  continue  and  to  do  so  in  a  manner  that  is  optimal  in 
the  sense  of  minimizing  the  approximation  error  in  the  thinned  model.  Using  deep 
results  in  information  geometry  and  maximum  entropy  modeling,  we  have  developed 
a  principled  method  for  doing  this  and  for  doing  it  in  a  manner  that  allows  us  to 
control  the  tradeoff  of  the  level  of  thinning  performed  and  the  informational  fidelity 
of  the  thinned  model.  The  result  is  a  powerful  methodology  that  allows  very  flexible 
processing  and  scalable,  near-optimal  performance  on  very  large  networks. 

(9)  One  of  the  principle  application  area  of  our  work  on  network-constrained  fusion  has 
been  in  algorithms  for  scalable,  communication-sensitive  distributed  data  association 
and  multi-target  tracking  in  sensor  networks.  The  first  contribution  of  our  research  in 
this  area  was  the  development  of  an  automatic  method  for  mapping  a  data  association 
and  tracking  problem  to  a  graphical  model  —  a  step  that  identifies  the  informational 
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relationships  among  sensors  and  targets  and  also  makes  clear  how  message-passing 
should  be  accomplished  (one  aspect  of  this  is  that  the  resulting  graphical  model  also 
identifies  a  critical  problem  in  sensor  networks,  namely  that  of  deciding  which  sensor 
is  responsible  for  what  part  of  the  overall  tracking/estimation  problem  and  also  for 
managing  handoff  from  one  sensor  to  another  as  dynamic  scenarios  evolve.  The  second 
contribution  of  our  work  was  the  application  of  advanced  inference  algorithms  for 
these  graphical  models  —  not  only  BP  but  also  the  tree-reweighted  algorithms  that 
yield  truly  optimal  solutions  —  and  for  the  introduction  of  a  very  flexible  message- 
censoring  protocol  in  which  sensors  decide  on  each  iteration  if  they  have  sufficient 
new  information  to  transmit  or  if  their  next  message  should  be  “censored”  (i.e.,  not 
transmitted).  This  leads  to  fully  adaptive  algorithms,  and  experiments  on  problems 
of  some  size  (more  than  40  targets)  provide  a  picture  of  clear  threshold  effects  in  the 
tradeoff  between  censoring  threshold  and  fusion  performance  —  this  in  turn  provides 
a  powerful  method  for  setting  these  thresholds.  The  last  part  of  our  work  has  involved 
the  incorporation  of  NBP  algorithms  for  dynamic  tracking  and  data  association.  In 
so  doing  we  have  developed  a  graphical  model  framework  for  multi-target  tracking 
that  offers  the  potential  of  dramatic  computational  gains  over  all  existing  algorithms 
for  this  problem  —  and  thus  is  of  considerable  value  for  applications  well  beyond 
sensor  networks.  The  key  here  is  the  exploitation  of  NBP’s  efficient  sampling  of  the 
combinatorially  explosive  set  of  possible  dynamic  data  association  hypotheses  rather 
than  their  explicit  enumeration  and  pruning.  A  paper  based  on  this  portion  of  our 
work  received  another  best  paper  award. 

(10)  We  have  developed  a  powerful  new  variational  approach  to  sparse  source  localization 
from  passive  sensor  arrays.  We  have  demonstrated  that  this  approach  has  superior 
super-resolution  capacity  when  compared  to  the  most  powerful  previously  developed 
methods.  Moreover  the  method  has  far  greater  robustness  to  the  number  of  snapshots 
used,  to  signal-to-noise  ration,  and  to  correlation  in  the  sources  being  separated  (a 
serious  problem  in  multipath  environments).  Moreover  the  technique  can  deal  readily 
with  wideband  sources  and  also  allows  simultaneous  source  localization  and  correction 
for  errors  in  our  knowledge  of  the  locations  of  the  sensors  in  the  array.  Our  analysis 
provides  conditions  under  which  a  convex  optimization  problem  (corresponding  to  1- 
norrn,  i.e.,  absolute  error)  yields  the  solution  to  the  non-convex  problem  corresponding 
to  the  p-norm  with  p  <  1  (and  in  particular  to  the  true  sparseness  norm  corresponding 
to  p  =  0).  More  generally  we  have  developed  powerful  optimization  problems  to 
solve  these  non-convex  problems.  These  results  have  been  shown  to  have  excellent 
performance  on  ARL-provided  data  sets  and  also  led  to  collaboration  with  Dr.  Brian 
Sadler  of  ARL  on  another  application  exploiting  sparseness  formulations. 

(11)  We  have  developed  information-theoretic,  nonparametric  methods  for  the  computa¬ 
tion  of  likelihoods  for  the  associations  of  signals  from  multiple  sensors.  This  work  was 
motivated  by  problems  in  which  dispersive  effects  (e.g.,  in  the  propagation  of  acoustic 
signals)  are  sufficiently  severe  that  coherent  array  processing  methods  fail.  This  ap¬ 
proach  corresponds  to  hypothesis  testing  over  factorizations  of  the  joint  distributions 
of  mutiple  signals  (i.e.,  are  particular  signals  dependent  or  independent)  when  we  know 
little  or  nothing  about  the  forms  of  the  specific  details  of  those  factors.  This  method 
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has  also  been  successfully  applied  to  the  problem  of  determining  if  several  targets  under 
track  are  moving  independently  or  in  coordination. 

(12)  We  have  also  developed  information-theoretic  methods  for  sensor  resource  management 
using  dynamic  optimization  formulations  and  approximate  dynamic  programming  so¬ 
lution  methods  that  take  advantage  of  the  particular  structure  of  such  problems  for 
sensor  networks.  The  optimization  criteria  used  in  this  work  combine  information- 
theoretic  measures  of  performance  (e.g.,  entropy  of  the  distribution  for  the  location  of 
a  target  and  mutual  information  between  a  target  and  a  potential  sensor  measurement 
that  can  be  taken)  with  terms  reflecting  the  cost  of  various  resource  consumption  ac¬ 
tivities  which  include  the  tasking  of  particular  sensors  to  expend  power  to  take  and 
transmit  measurements  to  the  node  responsible  for  fusion  and  the  communication  cost 
of  handing  off  that  fusion  responsibility  from  node  to  node. 

(13)  We  have  also  developed  a  framework  for  team-optimization  in  sensor  networks.  This 
deals  with  the  recognized  problem  that  sensor  networks  need  to  organize  themselves  in 
order  to  decide  what  bits  of  information  each  sensor  must  send  to  other  sensors  in  order 
for  the  overall  system  to  optimize  a  combined,  overall  objective.  We  have  demonstrated 
that  the  solution  to  such  problems  involves  message-passing  itself  —  i.e.,  each  node 
needs  to  receive  messages  that  (i)  allow  it  to  optimize  the  value  of  the  bits  it  will  send  to 
other  nodes;  and  (ii)  provide  statistical  information  so  that  the  node  knows  how  to  fuse 
bits  it  receives  from  other  nodes  in  an  optimal  manner.  In  essence  these  optimization 
problems  are  aimed  at  developing  a  fusion  protocol  for  how  the  sensors  should  work 
together.  This  also  makes  clear  that  there  is  a  communication  overhead  in  ad  hoc 
sensor  networks  that  is  more  significant  than  in  standard  ad  hoc  wireless  networks, 
as  in  this  case,  the  nodes  are  working  in  concert  toward  a  shared  (but  distributed) 
objective,  requiring  another  level  of  coordination  beyond  that  of  organizing  network 
connectivity  and  routing. 

(14)  We  have  developed  a  new  algorithm  based  on  Burrows  Wheeler  block  sorting  transform 
to  estimate  entropy  and  divergence,  which  assumes  very  little  knowledge  of  the  sources. 
We  have  proved  convergence  of  our  algorithm  and  experiments  show  that  the  algorithm 
converges  fast  and  is  computationally  efficient.  We  also  study  the  estimation  algorithm 
based  on  context  tree  weighting  method  and  find  that  with  the  idea  of  freezing  model, 
context  tree  weighting  method  is  very  useful  in  estimating  divergence.  We  apply  our 
algorithm  of  divergence  and  mutual  information  estimation  on  the  MURI  data  collected 
by  acoustic  sensor  arrays,  and  find  the  preliminary  results  quite  interesting. 

(15)  We  have  been  investigating  various  aspects  of  the  theoretical  limits  on  throughput 
achievable  in  communication  networks.  While  the  goal  is  to  understand  ad-hoc  config¬ 
urations,  such  as  applicable  to  the  sensor-web  case,  simpler  models  are  studied.  This 
facilitates  analysis  and  intuitive  understanding.  Among  our  scientific  accomplishments 
are:  (i)  a  derivation  of  the  transport  capacity  achievable  in  a  broadcast  channel  sce¬ 
nario  and  the  resource  distribution  (’’power  control”)  strategies  which  achieve  the  best 
results;  (ii)  a  proof  of  capacity  for  a  multi-relay  degraded  Gaussian  channel  which  ex¬ 
tends  earlier  work  of  Cover  and  El  Garnal  and  compliments  some  of  the  recent  work 
by  Xie  and  Kumar;  (iii)  a  result  which  shows  that  random  or  randomized  wired  links 
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in  a  wireless  network  can  potentially  provide  significant  efficiency  improvements  over 
a  cellular-type  infrastructure. 

(16)  We  have  developed  optimal  resource  allocation  and  scheduling  methods  in  wireless 
communications,  in  settings  where  energy  consumption  is  important  and/or  other  com¬ 
munication  resources  are  limited  (as  is  typically  the  case  in  sensor  networks).  In  partic¬ 
ular,  we  provide  tractable  dynamic  programming  algorithms  that  lead  to  policies  under 
which  a  transmitter  can  decide  at  what  times  to  transmit,  depending  on  the  state  of 
the  channel,  the  energy  available  in  the  transmitter’s  battery,  and  the  deadline. 

(17)  We  have  developed  a  new  class  of  network  formation  models  aimed  at  modeling  situa¬ 
tions  where  central  coordination  is  impractical,  so  each  node/sensor  will  establish  con¬ 
nectivity  after  a  “local  negotiation,”  carried  out  on  the  basis  of  perceived  self-interest. 
Our  work  has  resulted  in  a  characterization  of  the  networks  that  might  emerge. 

(18)  We  have  studied  the  dynamics  of  a  set  of  agents,  or  sensors,  that  wish  to  reach  con¬ 
sensus  on  a  certain  value  (e.g.,  a  common  estimate  of  a  parameter  being  estimated)  by 
exchanging  and  averaging  their  current  values.  We  have  established  broad  conditions 
for  convergence  (including  for  the  case  of  complete  asynchronism  in  the  information 
exchange  process),  as  well  as  convergence  rate  results.  In  addition,  we  have  developed 
variants  of  the  method  that  can  offer  improved  convergence  guarantees. 

(19)  In  joint  work  with  Nigel  Newton  (University  of  Essex,  UK),  we  have  given  a  Varia¬ 
tional  Interpretation  of  Bayesian  Inference  in  terms  of  a  minimization  of  Free  Energy, 
and  shown  how  the  path  estimation  problem  for  a  diffusion  process  (At)t>o  given  noisy 
observations  (Yt)t> o,  leads  to  a  structure  for  the  estimator  as  a  backward  likelihood  Fil¬ 
ter  composed  with  an  appropriate  forward  Optimal  Markovian  Stochastic  Controller. 
The  conditional  distribution  is  then  the  path-space  measure  of  the  optimally  controlled 
stochastic  system.  In  subsequent  work  we  have  given  a  statistical  mechanical  inter¬ 
pretation  of  the  Kalman  Filter  by  studying  it  in  terms  of  the  interaction  between  the 
signal,  observation  and  the  filter.  A  new  notion  of  Interactive  Entropy  production 
is  presented  and  it  is  shown  how  the  Kalman  Filter  is  informationally  optimal  and 
satisfies  a  Second  Law  of  Thermodynamics. 

(20)  We  are  currently  exploring  the  interaction  of  information  and  control  along  different 
directions.  The  first  line  of  investigation  is  to  establish,  as  a  starting  point,  analogies 
between  problems  of  information  transmission  and  problems  of  control,  and  use  these  in 
order  to  “transport”  known  results  from  one  area  to  the  other.  One  particular  point  of 
contact  between  information  and  control  that  we  have  been  and  are  currently  studying 
is  the  following:  It  is  well-known  in  information  theory  that  the  use  of  feedback  does 
not  increase  the  capacity  of  memoryless  channels,  while  for  channels  with  memory, 
feedback  does  often  increase  the  channel  capacity.  The  analogy  with  the  control  of 
mechanical  systems  is  clear:  The  “memory”  of  a  communication  channel  corresponds 
to  the  “inertia”  of  a  mechanical  system,  and  just  as  with  memoryless  channels  of 
information  theory,  mechanical  systems  without  inertia  can  be  controlled  without  the 
use  of  feedback.  This  points  further  to  a  duality  between  information  and  control: 
Controlling  a  given  plant  can  be  interpreted  as  transmitting  a  message  (desired  state 
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trajectory)  through  the  plant.  The  plant  controller  acts  here  as  the  message  encoder, 
while  the  state  observer  acts  as  the  message  decoder.  The  output  of  the  observer  is 
the  received  message.  We  are  attempting  to  substantiate  these  superficial  analogies  by 
establishing  mathematical  results  that  allow  us  to  reinterpret  information  transmission 
problems  as  control  problems,  and  vice-versa. 

(21)  Another  line  of  investigation  we  are  pursuing  takes  as  its  starting  point  the  work  of 
Mitter  and  Sahai  on  anytime  information  theory,  ft  has  been  shown  in  that  work  that 
the  use  of  information  transmission  in  a  control  application,  e.g.  communicating  the 
observer  output  back  to  the  controller  via  a  noisy  finite-rate  communication  channel, 
forces  us  to  rethink  classical  notions  of  information  theory,  and  to  forge  new  tools  to 
address  the  problems  engendered  by  the  interaction  of  communication  and  control. 
The  basic  result  that  has  been  established  in  that  work  is  that  in  this  new  context,  it  is 
not  enough  to  merely  get  the  bits  across  the  communication  channel,  it  is  also  essential 
to  know  what  these  bits  will  be  used  for.  This  is  a  major  departure  from  classical  infor¬ 
mation  theory,  and  leads  to  channel  characterizations  which  are  application-dependent 
and  go  well  beyond  coarse  single-number  characterizations  such  as  Shannon  capacity 
and  ergodic  capacity.  The  channel  characterization  (anytime  capacity)  established  by 
Mitter  and  Sahai  dealt  with  one  specific  application,  that  of  feedback  stabilization  of 
a  linear  control  system,  and  this  characterization  hinges  in  an  essential  way  on  the 
linearity  of  the  control  system.  We  are  currently  investigating  application-dependent 
channel  characterizations  for  control  systems  which  are  not  necessarily  linear  and  for 
control  objectives  other  than  stabilization. 

(22)  One  extension  of  these  ideas  is  to  consider  a  dense  network  of  systems  linked  via 
communication  channels.  Necessary  and  sufficient  conditions  on  the  communication 
channels  are  to  be  derived  for  the  network  to  exhibit  a  desired  behavior.  Although 
this  problem  seems  orders  of  magnitude  more  complex  than  that  of  a  single  control 
system  with  a  single  communication  channel  in  the  feedback  loop,  we  are  interested 
in  the  limiting  behavior  of  such  networks  as  the  number  of  sub-systems  and  channels 
grows  unbounded,  and  we  believe  the  complexity  of  behavior  of  such  a  network  can  be 
tamed  in  the  limit  as  its  size  becomes  infinite.  We  are  attempting  to  extract  partial 
differential  equations  that  describe  the  flow  of  information  in  such  a  network.  We 
expect  notions  such  as  “capacity  density”  in  a  (continuous)  network  to  play  a  role  akin 
to  that  of  capacity  (Shannon,  ergodic,  anytime,...)  of  a  single  communication  channel 
and  to  provide  a  key  characterization  of  the  behavior  of  such  networks,  which  can  then 
be  classified  as  homogeneous  or  inhomogeneous,  according  to  whether  they  do  or  do 
not  have  constant  capacity  density.  We  are  especially  interested  in  conservation  laws 
that  could  be  established  from  these  partial  differential  equations,  and  we  believe  such 
an  analysis  could  benefit  the  design  of  communication  networks. 

(23)  The  consideration  of  communication  networks  has  led  us  to  revisit  one  particular  clas¬ 
sical  channel,  the  Gaussian  broadcast  channel.  For  scalar  Gaussian  broadcast  channels, 
it  has  been  known  for  a  long  time  that  the  Gaussian  rate  region  is  not  only  achievable, 
but  that  it  is  also  the  capacity  region.  The  proof  of  this  last  statement  makes  crucial 
use  of  Shannon’s  entropy  power  inequality.  For  MIMO  Gaussian  broadcast  channels, 
the  achievability  of  the  Gaussian  rate  region  has  also  been  long  established,  but,  until 
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very  recently,  all  attempts  at  proving  that  the  Gaussian  rate  region  is  also  the  capacity 
region  for  such  channels  had  failed.  Very  recent  work  by  Shamai  and  his  collaborators 
has  bridged  this  gap  using  a  very  clever  idea  that  allows  the  entropy  power  inequality 
proof  of  the  scalar  case  to  go  through.  Unfortunately,  the  results  of  Shamai  and  his 
collaborators  are  very  closely  tied  to  the  Gaussianity  of  the  channel  considered,  and 
cannot  be  extended  to  the  case  of  non-Gaussian  broadcast  channels.  We  have  studied 
an  alternative  to  Shamai’s  proof  with  the  explicit  concern  that  the  underlying  princi¬ 
ple  transcend  the  particular  channel  characteristics,  and  in  particular,  its  Gaussianity. 
The  proof  we  propose,  and  which  is  only  partly  completed,  hinges  on  the  basic  idea 
of  dimensionality  reduction,  that  which  is  found  in  all  realms  of  mathematics,  and 
especially  in  the  Lie  theory  of  differential  equations  and  their  solvability  by  quadra¬ 
ture.  The  basic  idea  is  as  follows:  If  a  MIMO  channel  with  t  transmit  and  receive 
antennas  has  a  certain  capacity,  then  there  exists  a  sequence  of  codebooks  (with  code¬ 
words  of  length  n,  vectors  in  nt- dimensional  space)  with  rate  approaching  capacity 
and  probability  of  error  going  to  zero.  From  this  codebook,  we  can,  by  projection  onto 
an  n[t  —  1) -dimensional  sub-manifold,  extract  a  codebook  for  a  (t  —  1) -dimensional 
MIMO  channel  with  a  certain  limiting  rate  and  with  probability  of  decoding  error  ap¬ 
proaching  zero.  The  key  technical  passage  is  to  compute  estimates  of  the  size  of  the 
maximal  such  projected  codebook,  and  we  are  currently  working  on  this.  For  Gaussian 
MIMO  broadcast  channels,  the  projection  can  be  linear  and  the  sub-manifold,  a  linear 
subspace,  a  Gaussian  MIMO  broadcast  channel  with  t  transmit /receive  antennas  is 
then  reduced  to  a  Gaussian  MIMO  broadcast  channel  with  (t  —  1)  transmit /receive 
antennas,  but  with  the  same  number  of  users.  Reducing  step  by  step  the  problem  to 
that  of  the  scalar  Gaussian  broadcast  channel  allows  us  to  establish  the  capacity  region 
for  the  MIMO  case  using  the  existing  result  for  the  scalar  case.  As  alluded  to  above, 
the  projection  sub-manifold  need  not  be  a  linear  subspace,  and  the  projection  need  not 
be  linear,  and  we  believe  this  line  of  proof  can  be  generalized  to  non-Gaussian  MIMO 
broadcast  channels.  This  is  joint  work  with  Abdol-Reza  Mansouri. 

(24)  We  developed  a  novel  approach  to  detection  of  bio-releases  using  sparse  sensor  config¬ 
urations.  The  networks  of  interest  were  comprised  of  bio  material  sensors  (i.e.  type 
and  concentration)  and  a  smaller  number  of  wind  held  sensors  (i.e.  anemometers).  A 
consequence  of  sparse  configurations  is  that  the  wind  held  is  highly  uncertain  compli¬ 
cating  the  use  of  strong  physical  models.  This  research  focused  on  using  approximate 
physical  models  combined  with  optimal  inference  procedures.  The  parameters  of  in¬ 
terest  were  detection,  time-to-detection,  and  localization  for  a  hxed  false  alarm  rate. 
Experiments  were  designed  to  analyze  the  sensitivity  of  optimal  inference  methods 
in  which  the  underlying  physical  model  of  dispersion  deviated  from  that  assumed  by 
the  inference  procedure.  While  it  was  expected  that  localization  performance  would 
degrade,  it  was  shown  that  detection  probabilities  and  time-to-detection  performance 
were  more  robust  to  model  deviation  in  a  limited  number  of  experiments. 

(25)  Matrix  completion  problems  arise  in  settings  where  the  data  of  interest  can  be  arranged 
in  a  matrix  form  as  in  sensors  versus  objects  detectable  by  the  sensors.  Only  a  small 
fraction  of  the  entries  of  the  large  data  matrix  are  assumed  to  be  known  a  priori  and  the 
goal  is  to  accurately  predict  the  remaining  entries.  The  predictions  are  collaborative 
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in  nature  in  the  sense  that  they  make  tacit  use  of  shared  properties  across  sensors  and 
objects.  We  have  developed  new  algorithms  and  theoretical  analysis  of  collaborative 
prediction  based  on  extending  the  maximum  margin  concept  from  supervised  learning 
to  sparse  matrix  completion  problems.  The  estimation  task  is  formulated  as  a  convex 
optimization  problem  via  trace  norm  regularization,  and  can  be  solved  efficiently  in  the 
dual  form,  a  sparse  semi-definite  program.  Our  generalization  performance  analysis, 
through  the  use  of  Rademacher  complexity,  represents  the  first  generalization  analysis 
of  matrix  completion  methods. 

We  have  developed  a  new  information  theoretic  framework  for  solving  distributed  es¬ 
timation  and  inference  tasks.  We  focus  in  particular  on  the  setting  where  little  is 
known  about  the  probabilistic  interactions  between  the  variables  of  interest.  We  com¬ 
plement  the  absence  of  quantitative  dependencies  by  translating  structural  (relational 
and  topological)  constrains  into  information  theoretic  biases  about  the  values  of  the 
variables.  In  our  framework,  each  object  of  interest  (e.g.,  sensor)  is  associated  with 
a  set  of  variables  describing  them.  The  relations  between  objects  serve  to  bias  the 
probability  models  governing  the  variables  to  be  similar.  A  collection  of  such  biases 
define  a  regularization  approach  that  responds  appropriately  to  any  non-uniformity 
induced  by  limited  observations.  The  regularization  objective  is  minimized  in  an  iter¬ 
ative  manner  through  distributed  dual  projection  operations  (e-  and  m-projections). 
The  regularization  approach  generalizes  estimation  of  structured  probability  models 
from  incomplete  data,  reducing  to  it  in  the  simplest  case. 

Prof.  Kumar  and  his  students  Kurt  Plarre  and  Roberto  Solis  have  developed  an  al¬ 
gorithm  for  estimating  the  tracks  of  moving  objects  when  the  only  information  is  the 
time  information  as  objects  cross  highly  directional  sensors.  The  algorithm  determines 
the  sensor  directions  as  well.  It  has  been  implemented  on  Motes. 

Prof.  Kumar  and  his  student  Arvind  Giridhar  have  developed  a  theory  of  in-network 
processing  in  sensor  networks.  This  theory  allows  the  characterization  of  the  compu¬ 
tational  rate  for  some  classes  of  symmetric  functions  such  as  the  Mean,  Max,  Mode, 
etc. 
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